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ABSTRACT 

\ 

V  o/ 

The  theory  of  the  renewal  process  has  an  important  bearing  on  the  single 
server  queue,  especially  on  the  model  M/G/l  (although  some  results  are 
obtained  for  G/G/l  also).  Since  a  renewal  process  can  be  viewed  as  a 
single-server  saturated  system  (i.e.,  a  system  whose  source  keeps  the  server 
perpetually  busy)  this  affinity  is  not  suprising.  Moreover,  in  deriving  some 
results  for  the  renewal  process  we  gain  insight  into  the  use  of  the  conserva¬ 
tion  method,  based  on  the  application  of  ergodic  variables  and  of  the 
so-called  omni-transform,  to  the  treatment  of  single-sei-ver  queues. 

The  renewal  process  adds  insight  into  the  theory  of  mixtures  of  random 
variables  and  of  omni-forms  (i.e.,  linear  functions  of  omni -trans forms ) .  It 
allows  to  convert,  when  possible  in  principle,  an  omni-equation  involving 
derivatives  into  an  omni-equation  without  derivatives,  an  equation  which  is  a 
statement  about  a  mixture  of  distributions. 


1. 


The  Omni-Trans  form 


Let  Y  be  a  random  variable  and  <KY)  an  arbitrary  but  well-behaved 
function  of  Y;  "well-behaved"  means  that  the  expectation  of  »f»(Y)  is  finite, 
and  that  all  formal  operations  which  are  applied  are  valid.  This  rough 
description  will  suffice,  at  least  for  the  time  being.  In  most  of  our 
applications  Y  will  be  a  positive  random  variable. 

Definition  The  expectation  of  iKY) ,  an  arbitrary  (though  well-behaved) 

function  of  Y,  will  be  called  the  omni-transform  of  Y:  E[i/>(Y)]. 

This  is  a  very  wide  definition.  Thus,  the  Laplace  transform  of  Y  (i.e., 

the  Laplace  transform  of  the  distribution  of  Y)  is  obtained  by  putting  ^>(Y) 
_sv 

=  e  ;  the  generating  function  of  the  random  variable  N  is  obtained  by 

N 

putting  tf>(N)  =  z  .  In  a  future  report  we  will  show  how  to  derive 
omni-transforms  from  Laplace  transforms  and  from  generating  functions. 

The  omni-transform  owes  its  flexibility  to  the  free  choice  of  <f>(Y) ;  and 
its  ease  of  operation  to  the  fact  that  expectations,  because  of  their  additive 
property,  are  easy  to  handle.  Some  problems  which  require  the  inversion  of  a 
Laplace  transform  or  the  differentiation,  at  times  repeated  differentiation, 
of  a  transform  are  found  with  litte  effort  from  an  omni- equation.  The 
derivation  of  moments  is  especially  simple.  The  inverse  of  an  omni-transform 
is  not  even  defined  in  any  sense  analogous  to  the  inverse  of  a  Laplace 
transform. 

The  applications  of  omni-transforms  to  the  theory  of  runs  and  to  Markov 
and  semi-Markov  chains  will  be  described  in  a  future  report. 
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It  is  instructive  to  compare  the  equation 

x  =  y  (x  and  y  are  random  variables)  (1.1) 

with  the  omni-equation 

EI^(x)]  =  E[^(y) ] ,  for  all  i/>.  (1.2) 

Equation  (1.1)  states  that  x  and  y  are  identical,  i.e.,  that  "x"  and  "y" 
are  different  names  for  the  same  random  variable.  Equation  (1.2)  makes  the 
weaker  statement  that  x  and  y  have  the  same  distribution;  nothing  is  said 
about  x  and  y  being  identical,  dependent,  or  independent. 

The  equation 

E{e"SX]  =  E[e'sy],  for  all  s  >  sq,  (1.3) 

«sx 

which  is  a  special  case  of  (1.2)  when  ^>(x)  =  e  ,  also  leads  to  the 
conclusion  that  x  and  y  have  the  same  distribution  since  the  family  e  is 
rich  enough  for  this  conclusion  (indeed  the  validity  of  (1.3)  for  rational  s 
is  adequate).  But  omni-equations,  of  which  (1.2)  is  the  simplest  specimen, 
are  in  many  contexts  much  simpler  to  use  than  Laplace  transforms. 
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2.  The  Renewal  Process 

The  theory  of  the  renewal  process  has,  in  our  approach,  an  important 
bearing  on  the  single  server  queue,  especially  on  the  model  M/G/l  (although 
some  results  are  obtained  for  G/G/l  also).  Since  a  renewal  process  can  be 
viewed  as  a  single-server  saturated  system  (i.e.,  a  system  whose  source  keeps 
the  server  perpetually  busy)  this  affinity  is  not  surprising.  Moreover,  in 
deriving  some  results  for  the  renewal  process  we  gain  insight  into  the  use  of 
the  conservation  method,  based  on  the  use  of  ergodic  variables,  and  into  the 
use  of  omni-trans forms . 

Consider  a  service  station  (also  called  a  renewal  station)  and  an  ample 
source  of  customers  so  that  no  gaps  arise  between  services. 

Any  positive  random  variable  can  be  interpreted  as  service  time.  We  will 
usually  denote  the  service  time  as  x. 

Note  The  service  time  x  can  be  visualized  in  two  physically  different 

ways.  One  way  is  to  follow  the  demographic  or  actuarial  analogy  and  to 

treat  the  sojourn  time  x  as  a  kind  of  lifetime  subject  to  mortality  law; 

the  lifetime  of  an  arrival  is  known  only  statistically.  Another  way  is 

to  assume  that  a  customer  arrives  with  a  random  load  x  whose  precise 

value  is  revealed  at  the  instant  of  arrival  which  is  also  the  instant  of 

entry  into  the  station;  and  that  the  server  works  uniformly  on  the  load  x 

whose  measure  is  the  length  of  service.  The  second  interpretation  of  x 

is  usually  more  tractable  analytically  and  has  been  commonly  used  in 

queuing  theory  in  the  context  of  "unfinished  work."  Unless  otherwise 

< 

specified,  we  follow  the  random-load  interpretation. 

Along  with  x  we  consider  two  associated  random  variables:  "age"  (or 

"seniority")  and  "residual  life". 


Definition  of  Age  The  incumbent's  "age"  (or  "seniority")  is  the  time,  as  of  a 
given  instant,  which  he  has  already  spent  in  the  station.  The  age  can  be 
observed  continuously  or  in  a  Poisson  manner;  the  two  methods  yield  the  same 
probability  distribution,  a  fact  used  in  Monte  Carlo  and  in  simulation  models. 
When  there  is  no  ambiguity  we  can  denote  the  age  as  g,  a  random  variable. 
Definition  of  "Residual  Life"  The  incumbent's  "residual  life",  jr  "residue" 
for  terseness,  in  his  remaining  time  to  be  spent  in  service  as  of  a  given 
instant;  it  will  be  designated  by  r  when  there  is  no  ambiguity.  The  residue 
can  be  observed  continuously  or  in  a  Poisson  manner;  the  two  methods  yield  the 
same  probability  distribution. 

When  x  is  interpreted  as  the  working  load  which  is  numerically  equal  to 
the  service  time  we  have  dt  =  dg  =  -dr,  provided  that  the  service  is  not 
completed  during  dt. 

The  notation  r  and  g  is  satisfactory  when  one  considers  a  service  time 
which  is  not  a  function  of  other  random  variables  and  when  no  operations 
typified  by  "residue  of  a  residue"  enter  into  the  problem.  For  such  cases  a 
more  systematic  notation  is  introduced. 

Definition  of  the  Operators  R  and  G  The  operator  R  acting  on  the  positive 

random  variable  x  converts  it  into  the  residue  of  x:  Rx  =  residue  of  x. 

Similarly,  the  operator  G  converts  x  into  the  age  of  x:  Gx  =  age  of  x. 

Parentheses  will  be  used  in  cases  such  as  R(x+y).  An  n-fold  application  of 

the  operator  R  can  be  denoted  by  Rn.  The  operators  are  applied  in  order  of 

2 

their  proximity  to  the  argument.  Thus,  G  x  =  G(G(x))  and  RGx  =  R(Gx). 

« 

In  our  approach  to  renewal  and  queuing  models  under  steady-state 

conditions  we  will  make  much  use  of  what  we  call  ergodic  processes. 

Definition  A  process  Y  will  be  referred  to  as  ergodic  if  during  a  random 
dt  the  expected  change  of  <HY)  is  zero;  here  <KY)  is  an  arbitrary  function  of 
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Y  whose  expectation  is  finite.  This  definition,  ad  hoc  and  not  rigorous,  is 
intended  to  capture  the  essence  of  conservation  in  stochastic  models. 
Perhaps,  in  a  future  report  we  will  define  ergodic  processes  more  rigorously. 
So  far,  a  process  has  been  declared  to  be  ergodic  on  physical  or  economic 
grounds,  e.g.,  the  number  of  customers  in  a  queue  or  the  remaining  load. 

Consider  now  the  ergodic  process  Y  =  "time  spent  in  service  by  a  customer 
of  a  renewal  station."  This  process  manifests  itself  as  x  =  "completed 
service  at  an  instance  of  departure";  and  as  g  =  "age  of  an  incumbent  in 
service."  The  frequency  of  departures  (=  frequency  of  entries)  is  y  =  1/E(x). 
The  expected  change  of  Y)  during  a  random  dt  is  due  to  arrivals  and 
departures  and  aging:  dtyE[iJ>(0)]  due  to  arrivals;  -dtyE[^>(x)]  due  to 
departures;  and  dtE[^'(g)]  due  to  aging.  The  three  contributions  add  up  to 


+dtyE[<KO)]  -  dtyE[V>(x)  ]  +  dtE[<f>'(g)]  =  0. 


Hence,  replacing  y  by  1/E(x),  we  have 

E[<Kx)]  -  «K0)  =  E(x)E[*'(g)]. 


(2.1) 


We  will  refer  to  equations  valid  for  arbitrary  ♦  (  )  as  omni-equations. 
Equation  (2.1)  is  an  important  instance  of  a  linear  omni -equation,  each 
coefficient  of  V>(  )  and  of  its  derivative  being  a  constant.  In  a  linear 
omni-equation  there  is  never  a  term  without  ^»(  )  or  without  a  derivative  of 


In  order  to  simplify  the  typography  and  to  improve  the  esthetics  of 
omni -equations  we  introduce  the  omni-convention. 

i 

The  Omni -Convent ion:  In  a  linear  omni-equation  it  shall  be  understood  that 
each  V>(  )  or  ♦' (  ),  etc.  stands  for  E[<K  ))  or  E[<|>’(  )],  etc.  Thus,  equation 


(2.1)  can  be  written  as 


*(x)  -  *(0)  =  E(x)  *'(g). 


(2.2) 


•*  v- . 

v-* 
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(Our  omni -convent ion  is  analogous  to  the  summation  convention  of  tensor  and 

matrix  calculus,  the  so-called  Einstein  convention.) 

2 

Example  If  </»(x)  =  x  then  tp'  (g)  =  2g;  hence 

E(g)  =  E(x2)/2E(x) .  (2.3) 

k+i  k 

Example  If,  more  generally,  <p(x)  =  x  then  <f>'(g)  =  (k+l)g  and  (2.2) 
yields 

E(gk)  =  E(xk+1)/(k+l)E(x).  (2.4) 

Example  If  ^>(x)  =  E(e  SX)  then  <l>' (g)  =  -se  s®  and  (2.2)  yields 

E(e‘Sg)  =  [1  -  E(e‘SX)]/sE(x).  (2.5) 

Equation  (2.5)  relates  the  Laplace  transforms  of  x  and  g  =  Gx,  that  is, 
the  Laplace  transforms  of  their  probability  distributions. 

We  now  define 

F  (t)  =  Prob[x  £  t]  and  F  (t)  =  Prob[g  £  t)  ,  (2.6) 

x  g 

and  get  all  integrals  extending  from  0  to 
E[*(x)]  =  J  *(t)d[l  -  Fx(t) ] ; 

and  since  F  (t)  •*  1  as  t  +  «, 
x 

E[*(x)]  =  <K0)  +  /  [1  -  Fx(t)]diJ>(t).  (2.7) 

Furthermore, 

E[*’(g)]  =  I  *'(t)dFg(t)  =  /  Fg’(t)d«Kt).  (2.8) 

From  (2.1),  (2.7),  and  (2.8)  we  have 

J  [1  -  F(t)]d<Kt)  =  E(x)  /  F  ’(t)d*(t). 

X  8 

Since  tf>(t)  is  arbitrary  the  above  equation  implies  that 

F  ’(t)  =  [1  -  F*(t)]/E(x).  (2.9) 

O  X 
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(Note:  Equation  (2.9)  can  also  be  obtained  by  putting  <Kx)  =  H(t-x)  where 
H(t)  =  1  for  t  2  0  and  H(t)  =  0  otherwise;  and  treating  H'(t)  as  the  Dirac 
delta  function.) 

The  reasoning  which  has  led  to  the  derivation  of  (2.1)  can  be  repeated 
with  Z  =  "time  to  be  spent  in  service  by  a  customer  of  a  renewal  station"  in 
place  of  Y;  and  with  r  =  "residual  time  of  an  incumbent  in  service"  in  place 
of  g.  Note  that  the  two  random  variables  "completed  service"  and  "entering 


load"  have  identical  distributions. 

The  equation  (2.2),  has  its  analog  therefore  in 

<Kx)  -  <H0)  =  E(x)<f>'(r)  (2.10) 

and  (2.9)  has  its  analog  in 

Fr’(t)  -  [1  -  Fx(t)]/E(x),  (2.9a) 

where  Fr(t)  =  Prob[r  St],  In  turn,  Equations  (2.3),  (2.4),  and  (2.5)  can 
be  extended  to 

E(r)  =  E(g)  =  E(x2)/2E(x)  (2.3a) 

E(rk)  =  E(gk)  =  E(xk+1)/(k+l)E(x)  (2.4a) 

E(e'Sr)  =  E(e_Sg)  =  E(l-e‘SX)/sE(x) .  (2.5a) 

Functions  of  Both  r  And  g 


Consider  now  the  ergodic  variable  Y  =  ip(r,g)  where  <Kr,g)  is  an  arbitrary 

function  of  r  and  g.  The  expected  change  in  *Kr,g)  during  a  random  dt  is  made 

2 

up  of  three  components  (if  we  omit  contributions  of  order  (dt)  ): 

(a)  the  continuous  contribution  while  service  is  in  progress  equals 

-Dj  iji(r,g)dt  +  D2^>(r,g)dt,  since  dt  =  dg  =  -dr;  here 
< 

is  the  partial  differentiation  operator  for  the  j-th  argument; 

(b)  the  contribution  of  arrivals  equals  <Kx,0)udt ;  and 

(c)  the  contribution  of  departures  equals  -<K0,x)ydt. 
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Therefore,  with  y  =  1/E(x), 

*(x,0)  -  *(0,x)  =  E(x)[D^(r,g)  -D^Cr.g)].  (2.11) 

Example  Let  $(r,g)  =  rmgn  with  mil  and  nil.  Then  ^(x,0)  =  ^(0,x) 
=  0  and 

mE[r  g  ]  =  nE[r  g  ].  (2.12) 

If  n  =  2  and  n  =  1  (cf.  (2.4a))  we  get 

E(rg)  =  E(r2/2)  =  E(g2/2)  =  E(x3)/6E(x).  (2.13) 

Similarly,  we  can  derive  the  expectations  of  higher  mixed  moments  of  r 
and  g  in  terms  of  the  moments  of  x.  Repeated  use  of  (2.12)  yields 


-.rnn-l  _  mi (n-1) ?  .  m+n-1. 

E(r  g  ]  -  (m+n-1)!  E(g  1 

Replacing  n-1  by  n  and  applying  (2.4a)  we  obtain 

p  r  in  n.  p  r  m+n ■%  .  > ui  t  n .  p  .  in^n^  1 .  >p  ^  /  .  . . .  / m  I  n » 
E(r  g  ]  =  E [g  ]/(  m  )  =  E[x  ] /E(x) (m+n+1) (  m  ) 


(2.14) 


(2.15) 


which  holds,  as  easily  verified,  for  m  £  0  and  n  S  0. 

Example  Let  tf»(r,g)  =  $(ar  +  bg) .  Note  that  this  is  a  specification,  and  not 
an  omni -equation,  and  the  omni -convent ion  does  not  apply;  therefore  we  use  two 
different  Greek  letters  in  the  specification.  Of  course,  $(  )  is  an  arbitrary 
function  of  its  argument.  Equation  (2.11)  implies  the  omni-equation  (omni¬ 
convention  applies) 

*(ax)  -  #(bx)  =  E(x)(a-b)*'  (ar  +  bg).  (2.16) 

When  a  =  b  (2.16)  results  in  0  =  0.  Let  us  therefore  see  what  happens  when 
a  ■*  b.  Let  a  =  b  +  6;  (2.16)  becomes,  upon  dividing  both  sides  by  a  -  b 


±  8»Y  tM  ,  E(x)  „.(br  +  Sr  +  bg). 
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When  5  -*■  0  and  b  =  1  we  have 

E[x0’(x)]  =  E(x)E[*'(r  +  g) ] .  (2.17) 

(Note  that  in  (2.17)  no  use  is  made  of  the  omni- convent  ion  because  the  term 
x$'(x)  makes  it  nonlinear.) 

Since  $'(  )  is  an  arbitrary  function  we  can  replace  it  by  another 

arbitrary  function  designated  by  4>(  ),  thus  reverting  to  the  more  customary 


designation,  and  (2.17)  becomes,  equivalently, 

E[<Kr+g)]  =  E[x<Kx)]/E(x).  (2.18) 

Example  Let  <Kr,g)  =  $(r-g).  From  (2.16)  with  a  =  1  and  b  =  -1  we  get 

$(x)  -  $(-x)  =  2E(x)$' (r-g) .  (2.19) 

Let  0(r-g)  =  (r-g)k.  We  have  from  (2.19) 

E[(r-g)k]  =E[xk+1  -  (-x)k+1]/2(k+l)E(x).  (2.20) 

Hence,  with  the  aid  of  (2.4a)  we  have 

k  k+1  k  k 

even  k  -  E[(r-g)K]  =  E(x  A)/(k+l)E(x)  =  E(gK)  =  E(r  )  (2.20a) 

odd  k  -»  E[(r-g)k]  =  0.  (2.20b) 


Let  us  now  derive  the  joint  probability  density  p(t,u)  of  the  residue  r  = 
Rx  and  the  age  g  =  Gx.  This  p(t,u)  is  the  probability  density  perceived  by 
either  a  perpetual  or  a  poissonian  observer  of  the  processes  x,  r,  and  g. 
[Note:  r  and  g  can  also  be  interpreted  in  terms  of  a  stationary  population  in 
a  demographic  model. ] 

Theorem  The  joint  probability  density  p(t,u)  of  r  =  Rx  and  g  =  Gx  satisfies 
p(t,u)  =  fx(t+u)/E(x)  (2.21) 

where  f^(t)  is  the  p.d.  of  the  lifetime  x. 

Proof  This  proof  is  based  on  (2.11).  All  integrals  in  the  proof  are  from 
0  to  •. 

E[D^(t,u)]  =  I  I  p(t,u)D1i/»(t,u)dtdu. 
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I  p(t,u)D  (Kt,u)dt  =  p(t  ,u)if>(t  ,u) I  -  I  <Kt,u)D.p(t,u)dt 

t=0  1 

and,  since  p(t,u)  tends  to  0  as  u  tends  to  ~, 

I  p(t,u)D1iKt,u)dt  =  -p(0,u)i/i(0  ,u)  -  I  p(t,u)D1p(t,u)dt 


J  I  p(t,u)D1(t,u)dtdu  =  -  /  p(0,u)iK0,u)du  -IS  p(t ,u)D1p(t ,u)dtdu 
Proceeding  similarly  for  EfD^^fr ,g) ]  we  find  that  the  right-hand  side  of 
(2.11)  is 

E(x)  EtDjiKr.g)  -  D2<Kr,g)]  =  E(x){-  I  p(0,u)^(0,u)du 

+  I  p(t,u)</»(t,0)dt  -SI  [D1p(t,u)  -  D2p(t,u)]^(t,u)dtdu)  (2.22) 

The  left-hand  side  of  (2.11)  is 

E[*(x,0)  -  *(0,x)]  =  /  fx(t)^(t,0)dt  -  I  fx(t)*(0,t)dt.  (2.23) 

Comparing  (2.22)  and  (2.23)  we  see  that  the  two  sides  of  (2.11)  are  equal  if, 

and  only  if,  the  following  three  conditions  are  satisfied: 

(a)  D1p(t,u)  =  D2p(t,u), 

(b)  fx(t)  =E(x)p(0,t),  and 

(c)  fx(t)  =  E(x)p(t,0) . 


It  follows  from  (a)  that 

p(t,u)  =  h(t+u)  for  some  function  h(  ). 


(2.24) 


Therefore,  (b)  and  (c)  each  becomes 


fx(t)  =  E(x)h(t). 


(2.25) 


Replacing  t  by  t+u  in  (2.25)  results  in  fx(t+u)  =  E(x)h(t+u);  replacing 
h(t+u)  by  p(t,u)  as  allowed  by  (2.24)  results  in 


E 


(2.21) 


p(t,u)  =  fx(t+u)/E(x) 
which  completes  the  proof. 

It  is  noteworthy  that  we  have  derived  the  mixed  moments  of  r  and  g,  given 
by  (2.15),  before  we  derived  the  probabilit  density  of  r  and  g  given  by 
(2.21).  Likewise,  we  derived  the  moments  of  g  given  by  (2.4)  before  deriving 
the  probability  density  of  g  given  by  (2.9).  Such  freedom  in  the  order  of 
derivation  is  common  when  one  is  working  with  the  omni-transform.  Indeed,  it 
is  easier  to  find  the  mixed  moments  from  (2.15)  than  from  the  joint 
probability  density  of  r  and  g  given  by  (2.21). 

Example  Consider  a  function  o(r+g) .  Its  expectation  is,  using  (2.21), 

•»  oo 

E[o(r+g)]  =  /  /  a(t+u)f  (t+u)dtdu/E(x) 

t=0  u=0  X 

With  y  =  t+u  and  z  =  t  we  get  (noting  that  the  Jacobian  of  the  transformation 
equals  1) 

oo  y  OO 

E[a(r+g)]  =  /  J  a(y)f  (y)dzdy/E(x)  =  I  ya(y)f  (y)dy/E(x) 
y=0  z=0  y=0 

Therefore, 

E[a(r+g)]  =  E[xa(x)]/E(x) .  (2.26) 

When  a(r+g)  =  (r+g)  equation  (2.26)  becomes 

E[(r+g)k]  =  E(xk+1)/E(x),  (2.27) 

an  equation  known  from  the  theory  of  stationary  populations. 
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3.  The  Shifted  Renewal  Equation 

The  renewal  equation  in  (x,r)  form  is 

4>(x)  =  *(0)  +  E(x)^'  (r).  (3.1) 

Let  $(x)  =  $(x+b)  where  $(  )  is  another  arbitrary  function,  and  b  is,  for 
the  time  being,  a  constant.  Then  (3.1)  becomes 

$(x+b)  =  0(b)  +  E(x)$’  (r+b)  .  (3.2) 

The  omni-convention  applies,  of  course,  to  the  $(  )  as  well  as  to  the 
<K0).  We  can  think,  if  we  wish,  of  b  in  (3.2)  as  an  outcome  of  a  random 
variable  y  which  is  independent  of  the  variables  x  and  r.  Thus, 

0(x+y)  =  $(y)  +  E(x)$'(r+y).  (3.3) 

In  (3.3)  the  expectation  of  0(x+y)  is  taken  with  respect  to  x  and  y;  of 
$(y)  with  respect  to  y;  and  of  #'(r+y)  with  respect  to  r  and  y.  We  will  refer 
to  (3.3)  as  the  "shifted  renewal  equation." 

We  will  refer  to  y  as  the  "shift"  and  to  x  as  the  "core".  In  (3.3),  the 
core  x  must  be  positive  while  the  shift  y  need  not  be  positive. 

When  the  r.v.  y  is  positive  we  can  choose  to  treat  it  as  the  core  in 
0(x+y)  and  to  treat  x  as  the  shift.  Using  now  the  operator  R  (recall  that 
Rx  =  residue  of  x)  we  write 

0(x+y)  =  0(x)  +  E(y)$'(Ry+x)  (3.4) 

while  (3.3)  can  be  written  as 

$(x+y)  =  $(y)  +  E(x)$' (Rx+y) .  (3.3a) 

The  shifted  renewal  equation  plays  an  important  role  in  our  treatment  of 
the  M/G/l  model,  and  some  role  in  the  G/G/l  model.  This  topic  is  left  to  a 
future  report.  The  use  of  the  shifted  renewal  equation  in  the  integration  of 
omni-equations  is  described  in  Section  4  of  this  report. 


Mixtures  of  Random  Variables 

Definition  We  say  that  the  random  variable  Y  is  a  mixture  of  the 


random  variables  x^  with  weights  if 

Prob(Y  £  t)  =  Prob(x^  <  t)  +  +  Prob(x^  <  t) 


(4.1) 


where  p^  2  0  and  Ip^  =  1.  We  can  similarly  define  a  mixture  of  random 
processes . 

Equation  (4.1)  can  be  stated  in  an  equivalent  form  using  omni-transforms: 


*(Y)  =  pi*(x.)  +  +  Pk4»(xk) 


(4.2) 


In  this  report  we  consider  only  finite  mixtures,  i.e.,  with  k  <  «.  [For  a 
continuous  mixture  we  can  write 

E[iHY)]  =  I  p(t)  <Kx,t)dt,  with  p(t)  *  0  and  /p(t)dt  =  1  (4.3)] 

A  mixture  of  random  variables  can  be  visualized  as  a  two-stage  experiment 
in  which  first  one  of  the  x^  is  drawn  (with  probability  ) ;  and  then  a 
value  of  x^  is  drawn  (according  to  the  distribution  of  x^) . 

Whereas  sums  of  random  variables,  especially  of  sums  of  independent 
random  variables  (and  their  convolutions  and  limits)  have  been  dealt  with 
extensively  in  the  literature,  mixtures  have  not  been  dealt  with  often.  The 
use  of  omni-transforms  in  the  theory  of  mixtures  appears  to  be  new. 


From  the  renewal  equation  we  get 
*(Y)  =  *(0)  +  E(Y)  4>’  (RY) 


«(xi)  =  <K0)  +  E(xi)  ^'(Rx^ 


(4.4) 


(4.5) 


where  R  is  the  residue  operator  defined  by  Rx  =  residue  of  x. 
It  follows  from  (4.2),  (4.4),  and  (4.5)  that 


E(Y)*(RY)  =  p1E(x1)^(Rx1)  +  +pkE(xk)*(Rxk)  (4.6) 

Thus,  RY  is  a  mixture  of  the  Rx^  with  weights  p^E(x^)/E(Y) .  (Note 


that  these  weights  sum  to  one  since  E(Y)  =  l  p^E(x^). 


■: . 


v-  .1 


.  • .  •  w  * 
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We  now  derive  an  expression  for  the  residue  of  the  sum  of  two  independent 
positive  random  variables,  and  x^.  From  (3.3)  we  get 

(KXj  +  x2)  =  <Kx2)  +  E(x1)^>’(Rx1  +  x2)  (4.7) 

Now,  we  treat  Rx^  in  (4.7)  as  the  shift  and  x2  as  the  core. 
Therefore, 

(Rx:  +  x2)  =  (Rxx)  +  E(x2)^"(RXl  +  Rx2)  (4.8) 

Since, 

<Kx2)  =  *(0)  +  E(x2)t/>'  (Rx2) 
we  get  from  (4.7)  and  (4.8) 

<KXl+x2)  =  <K0)  +  E(x1)^'  (Rxx)  +  E(x2)*'  (Rx2) 

+  E(x1x2)<|;"(Rx1+Rx2)  (4.9) 

H,- 

But  we  also  have,  treating  x^  +  x2  as  the  core  (with  shift  zero), 

*(Xi+x2)  =  *(0)  +  E(xx  +  x2)*'(R(x1  +  x2)) . 

From  above  and  (4.9)  we  have 

E(x1+x2)(/>'  (R(xx+x2))  =  E(xx)^'  (Rxp  +  E(x2)i/»'  (Rx2) 

+  E(x1x2)*"(Rx1  +  Rx2)).  (4.10) 

Define  now  $(  )  =  4>' (  ).  Then  $'(  )  =  <J<"(  )  and  (4.10)  can  be  written  as 
E(x1+x2)0(R(x1+x2))  =  E(x1)0(Rx1)  +  E(x2)^(Rx2) 

+  E(x1x2)#'(Rx1  +  Rx2).  (4.11) 

However,  since  ♦(  )  is  a  general  function  of  its  argument  just  as  4>(  )  is,  we 
can  replace  each  $  by  </>,  thus  obtaining 

E(x1+x2)«/»(R(x1+x2))  =  E(x1)^(x1)  +  E(x2)<KRx2) 

+  E(x1x2)«(»,(Rx1+Rx2)  (4.12) 

Thus,  we  obtain  (4.12)  from  (4.10),  where  each  term  is  of  order  one  or  higher, 
by  "integrating"  each  term.  Conversely,  if  we  start  with  (4.12)  we  can 
"differentiate"  each  term.  When  "integrating"  or  "differentiating"  a  linear 


omni-equation  we  obtain  again  a  valid  linear  omni -equation;  when  "integrating" 


an  omni-equation  there  is  no  need  to  worry  about  a  constant  term:  none  is 
needed.  Of  course,  we  "integrate"  only  omni- equations  whose  each  term  is  of 
order  at  least  one. 

Note  now  that  neither  (4.10)  nor  (4.11)  nor  (4.12)  is,  explicitly  at 
least,  a  statement  about  a  mixture  because  not  all  terms  are  of  the  same 
order.  Some  omni-equations  with  terms  of  different  order  can  be  "integrated" 
into  an  equation  of  order  zero  which  is  a  statement  about  a  mixture.  Thus, 
consider  the  omni-equation  with  positive  random  variables  x  and  w 

X[<Kw+x)  -<Kw)]  =V-'(w)  -  (l-p)0'(O)  (4.13) 

which  comes  up  in  the  M/G/l  model.  (The  interpretation  of  (4.13)  is  not  now 
important.)  We  luckily  recognize  that  (cf.  (3.2)) 

^>(w+x)  -  V>(w)  =  E(x)^'(Rx+w)  (4.14) 

which  along  with  (4.13)  results  in 

XE(x)*'(w+Rx)  =  V»'(w)  -  (l-p)^'(O).  (4.15) 

We  can  now  replace  each  4>'  by  tfi,  thus  obtaining 

XE(x)tf>(w+Rx)  =  tfi(w)  -  (l-p)^(O).  (4.16) 

Let  us  now  put  ♦(  )  =  1.  Then  (4.16)  becomes 
XE(x)  =  1  -  (1-p)  and  XE(x)  =  p. 

Therefore,  (4.16)  can  be  written  as 

♦  (w)  =  (l-p)<K0)  +  p0(w+Rx).  (4.17) 

Thus,  using  the  renewal  equation  we  have  succeeded  in  genuinely  integrating 
the  omni-equation  (4.13),  that  is  converting  (4.13)  into  an  equivalent 
equation  whose  all  terms  are  of  order  zero.  (The  "integration"  of  (4.10)  to 
(4.12)  is  essentially  a  typographical  operation.)  Such  an  omni-equation  is 
equivalent  to  a  statement  about  a  mixture.  In  particular,  (4.17)  is 
equivalent  to 

Probfw  £  t]  =  (l-p)Prob(O  £  t]  +  pProb[w+Rx  £  tj  (4.18) 
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i.e. , 

Prob[w  5  t]  =  (1-p)  +  pProb[w+Rx  S  t].  (4. 19) 

The  coefficients  on  the  right-hand  side  of  (4.18)  are  positive  and  add  up  to 
one.  This  makes  the  distribution  of  w  a  mixture  of  0  with  weight  1-p,  and  of 
the  distribution  of  w+x  with  weight  p. 

When  x  is  known  we  can  obtain  from  (4.17)  the  moments  of  w;  and  from 
(4.19)  an  integral  equation  for  the  distribution  of  w.  We  shall  pursue  this 
problem  in  connection  with  the  discussion  of  the  model  M/G/l. 

What  about  the  renewal  equation  itself, 

^(x)  =  <K0)  +  E(x)^'  (Rx)  , 

can  this  be  integrated  into  a  mixture?  No,  it  cannot  and  neither  can  a 
shifted  renewal  equation.  (It  is  a  case  of  a  wonder  physician  who  can  cure 
everyone  else  but  not  himself.)  Equations  (4.7)  and  (4.1?)  are,  in  essence, 
already  equivalent  to  a  shifted  renewal  equation  and  an  attempt  to  convert 
them  into  a  mixture  will  result  in  0  =  0.  It  is  for  this  reason  that  we 
selected  (4.13)  to  convert  into  a  mixture.  We  will  derive  (4.13)  in  a  future 
report . 

Note  Equation  (4.9)  can  be  extended  to  the  case  of  ip(x^  +  +  x^) .  We 

shall  write  down,  without  proof,  the  analog  of  (4.9)  for  k  =  3.  The  general 
pattern  does  emerge  from  k  2  and  k  =  3. 

<KX1  +  x2  +  x3)  =  *(0)  +  E(x1)i#»'  (Rxp  +  E(xh2)i*i'  (Rx2) 

+  E(x3)*'(Rx3)  +  E(x1x2)«p"(Rx1  +  Rx2) 

+  E(x2x3)*"(Rx2  +  Rx3)  +  E(x3x1)^"(Rx3  +  Rxx) 

+  E(x1x2x3)i(i'  '  '  (Rx1  +  Rx2  +  Rx3) .  (4.20) 
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